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What is claimed is: 

1. A method for constructing a database having digital 
video data information representing a plurality of video 
5 sequence, each video sequence having a set of image frames 
of the digital video data, the method comprising the steps 
of: 

a) partitioning each image frame of each video 
sequence into L number of sub images, wherein each sub- 

10 image is further partitioned into S x T number of image- 
blocks, L, S and T being positive integers; 

b) assigning one of 5 number of reference edges to 
each image-block to thereby generate L number of edge 
histograms for each image frame, wherein the edge 

15 histograms include the M edge histogram bins and the 
reference edges include 4 number of directional edges and a 
non-directional edge; 

c) normalizing the edge histogram bins contained in 
each edge histogram by S x T to thereby generate M number 

20 of normalized edge histogram bins for said each image 
frame; 

d) calculating M representative edge histogram bins of 
said each video sequence in order to generate L number of 
representative edge histograms of each video sequence based 

25 on the normalized edge histogram bins of said each image 
frames; and 

e) non-linear ly quantizing the representative edge 
histogram bins to generate M number of quantization index 
values as a second image descriptor for said each 

30 representative edge histogram to be stored in the database. 

2. The method as recited in claim 1, wherein the 
directional edges includes a vertical edge, a horizontal 
edge, a 45 degree edge, a 135 degree edge and the non- 
35 directional edge represents an edge of undesignated 

direction except for the 4 directional edges. 

3. The method as recited in claim 2, wherein the 
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vertical edge, the horizontal edge, the 45 degree edge, the 
135 degree edge and the non-directional edge are, 
respectively, expressed as: 



vertical horizontal 



edge 



edge 



45 degree 
edge 



130 degree 
edge 



non-directional 
edge 



4. The method as recited in claim 3, wherein the step 
a) includes the steps of: 

a-1 ) dividing said each image frame into N x N non- 
10 overlapping sub-images to thereby form L number of 
rectangle-shaped sub-images, N being a positive integer; 
and 

a-2) dividing the sub-image into S x .T non-overlapping 
blocks to thereby form S x T number of square-shaped image- 
15 blocks . 



5. The method as recited in claim 4, wherein the step 
b) includes the steps of: 

b-1) assigning one of the reference edges to each 
20 image block; and 

b-2) counting the number of each reference edge 
included in each sub- image to generate the L number of the 
edge histograms for the each image frame. 



25 6. The method as recited in claim 5, wherein the step 

b-1) includes the steps of: 

b-11) dividing each image-block into 2x2 sub-blocks; 
b-12) assigning a corresponding filter coefficient to 
each sub-block; 

30 b-1 3) calculating a set of 5 edge magnitudes 

corresponding to five edges for each image-block by using 
the filter coefficient? and 

b-14) expressing the image-block as an edge having a 
maximum edge magnitude by comparing the calculated edge 

23 BEST AVAILABLE COPY 



WO 2004/040912 



PCT/KR2003/000101 



magnitudes each other. 

7. The method as recited in claim 6, wherein the 5 
edge magnitude are obtained by using 5 number of equations, 
which are expressed as: 

3 

m v ft j) - 1 2 * k ft J) */v (*) I ; 

3 

m " (/ ' J ' )=3 i 2**ft \ *' 

«*-4s(U)-| jj«*ftj>/**<*) |; 

3 

^d-iss ft /) - 1 X ft /) x/^ 13 5 (*) | ? and 



10 «*ft./)-| g**(U)x/™i(*) | , where m v (W) , m h (i,j) , m d _ 45 (i,j) , 

m 4-tx(**J) and m nd(^J) 9 respectively, denote vertical, 
horizontal, 45 degree, 135 degree and non-directional edge 
magnitudes for a th image-block; a k (j,j) denotes an 

average gray level for a sub-block assigned k in the ft;) th 

15 image-block and f v (*) , f h (k) , / d _ 45 (A:), / d _ 135 (£) and f nd (k) denote, 
respectively, filter coefficients for the vertical, 
horizontal, 45 degree, 135 degree and non-directional edges 
where k represents a number assigned to each sub-block. 

20 8. The method as recited in claim 6, wherein the 

maximum edge magnitude is greater than a predetermined 
threshold value, otherwise the image block is considered to 
contain no edge. 

25 9. The method as recited in claim 1, wherein the 

representative edge histogram bins are calculated based on 
a mean value of corresponding edge histogram bins of image 
frames of the video sequence. 

30 10. The method as recited in claim 1, wherein the step 

e) includes the step of el) non-linear ly quantizing each of 

the representative edge histogram bins by using a 
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corresponding non-linear quantization table, wherein the 
step el) is provided with 5 number of non-linear 
quantization tables, each corresponding to said each 
reference edge. 

5 

11. The method as recited in claim 10, wherein the 
step el) includes the steps of: 

e2-l) mapping each of the representative edge 
histogram bins into a representative value contained in 
10 each corresponding reference edge quantization table; and 

e2-2) generating 3 bits of a quantization index value 
representing the representative value for said each 
representative edge histogram bin to thereby generate L x 5 
number of the quantization index values as the second image 
15 descriptor for the video sequence. 

12. The method as recited in claim 10, wherein the 
normalized edge histogram bins are non- linearly quantized 
by using a- non-linear quantizer that is designed based on a 

20 Lloyd-Max algorithm, 

13. The method as recited in claim 5, wherein said N 

is 4 . 

25 14. The method as recited in claim 12, wherein the 

quantization table includes a table for a vertical edge 
histogram bin representing the number of vertical edges in 
the sub-image, which is expressed as: 



Index 


Range 


Representative 
value 


0 


0.0000000 ~ 0.0343910 


0.010867 


1 


0.0343910 ~ 0.0787205 


0.057915 


2 


0.0787205 ~ 0.1221875 


0.099526 


3 


0.1221875 ~ 0.1702110 


0.144849 


4 


0.1702110 ~ 0.2280385 


0.195573 


5 


0.2280385 ~ 0.3092675 


0.260504 
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6 


0.3092675 ~ 0.4440795 


0.358031 


7 


0.4440795 ~ 1.0000000 


0.530128 



15. The method as recited in claim 12, wherein the 
quantization table further includes a table for a 
5 horizontal edge histogram bin representing the number of 
horizontal edges in the sub-image, which is expressed as: 



Index 


Range 


Representative 
value 


0 


0.0000000 ~ 0.0411000 


0.012266 


1 


0.0411000 ~ 0.0979065 


0.069934 


2 


0.0979065 ~ 0.1540930 


0.125879 


3 


0.1540930 ~ 0.2128515 


0.182307 


4 


0.2128515 ~ 0.2789795 


0.243396 


5 


0.2789795 ~ 0.3631455 


0.314563 


6 


0.3631455 - 0.4880235 


0.411728 


7 


0.4880235 ~ 1.0000000 


0.564319 



16. The method as recited in claim 12, wherein the 
quantization table further includes a table for a 45 degree 
edge histogram bin representing the number of 45 degree 
edges in the sub- image, which is expressed as: 



index 


Range 


Representative 
value 


0 i 


0.0000000 ~ 0.0150225 


0.004193 


1 


0.0150255 ~ 0.0363560 


0.025852 


2 


0.0363560 ~ 0.0576895 


0.046860 


3 


0.0576895 ~ 0.0809025 


0.068519 


4 


0.0809025 ~ 0.1083880 


0.093286 
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5 


0.1083880 ~ 0.1424975 


0.123490 


6 


0.1424975 ~ 0.1952325 


0.161505 


7 


0.1952325 ~ 1.0000000 


0 .228960 



17. The method as recited in claim 12, wherein the 

5 quantization table further includes a table for a 135 

degree edge histogram bin representing the number of 135 
degree edges in the sub-image, which is expressed as: 



Index 


Range 


Representative 
value 


0 


0.0000000 ~ 0.0150490 


0.004174 


1 


0.0150490 ~ 0.0360780 


0.025924 


2 


0.0360780 ~ 0.0566975 


0.046232 


3 


0.0566975 ~ 0.0784090 


0.067163 


4 


0.0784090 - 0.1025230 


0.089655 


5 


0.1025230 ~ 0.1336475 


0.115391 


6 


0.1336475 - 0.1848245 


0.151904 


7 


0.1848245 - 1.0000000 


0.217745 



18. The method as recited in claim 12, wherein the 
quantization table further includes a table for a non- 
15 directional edge histogram bin representing the number of 
non-directional edges, which is expressed as: 



Index 


Range 


Representative 
value 


0 


0.0000000 ~ 0.0292225 


0.006778 


1 


0.0292225 ~ 0.0801585 


0.051667 


2 


0.0801585 ~ 0.1374535 


0.108650 
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3 


0.1374535 - 0.1952415 


0. 166257 


4 

« 


0.1952415 ~ 0.2549585 


0.224226 


5 


0.2549585 ~ 0.3210330 


0.285691 


6 


0.3210330 - 0.4036735 


0.356375 


7 


0.4036735 ~ 1.0000000 


0.450972 



19. The method as recited in claim 7, wherein 
semantics of said each edge histogram bin of BinCounts is 
5 defined as : 



Edge histogram bin 


Semantics 


BinCounts[0] 


Vertical edges in sub- image (0 f 0) 


BinCounts [ 1 ] 


Horizontal edges in sub-image (0,0) 


BinCounts [2 ] 


45 degree edges in sub-image (0 f 0) 


BinCounts[3] 


135 degree edges in sub- image (0,0) 


BinCounts [ 4 ] 


Non-directional edges in sub-image 
(0,0) 


BinCounts [ 5 ] 


Vertical edges in sub-image (0,1) 


• 
• 


• 
• 


BinCounts [74] 


Non-directional edges in sub-image 
(3,2) 


BinCounts [ 75 ] 


Vertical edges in sub-image (3,3) 


BinCounts [76] 


Horizontal edges in sub-image (3,3) 


BinCounts [ 77 ] 


45 degree edges in sub-image (3,3) 


BinCounts [78] 


135 degree edges in sub-image (3,3) 


BinCounts [ 79 ] 


Non-directional edges in sub-image 
(3,3) 



20- The method as recited in claim 1, further 
comprising step f) calculating a variation value of the 
10 video sequence and storing the variation value in the 
database, wherein the variation value includes a variance 
of the edge histograms of each image frames. 

21. A method for retrieving a corresponding video 
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sequence having a set of image frames of the digital video 
data in response to a query video sequence based on a 
database f the method comprising the steps of: 

a) calculating L number of representative edge 
5 histograms of the query video sequence as an image 

descriptor for the query video sequence, wherein each 
representative edge histogram represents a representative 
spatial distribution of 5 number of reference edges in sub- 
images of image frames in the query video sequence, wherein 
10 the reference edges includes 4 number of directional edges 
and a non-directional edge; 

b) extracting a plurality of image descriptors for 
video sequences based on digital video data information 
from the database, wherein each image descriptor for said 

15 each video sequence includes L number of representative 
edge histogram bins for said each video sequence; 

c) comparing the image descriptor for the query video 
sequence to said each image descriptor for each video 
sequences to generate a comparison result; and 

20 d) retrieving at least one video sequence similar to 

the query video sequence based on the comparison results . 

22. The method as recited in claim 21, wherein said 
each edge histogram has 5 number of edge histogram bins 

25 corresponding to the reference edges. 

23. The method as recited in ' claim 21, wherein the 
directional edges include a vertical edge, a horizontal 
edge f a 45 degree edge, a 135 degree edge and the non- 
30 directional edge represents an edge of undesignated 

direction except for the 4 directional edges. 

24. The method as recited in claim 21, wherein the 
step a) includes steps of; 

35 al) partitioning each image frame of query video 

sequence into L number of sub images, wherein each sub- 
image is further partitioned into S x T number of image- 
blocks, L, S and T being positive integers; 
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a2) assigning one of 5 number of reference edges to 
each image-block to thereby generate L number of edge 
histograms for each image frame, wherein the edge 
histograms include the M edge histogram bins and the 
5 reference edges include 4 number of directional edges and a 
non-directional edge; 

a3) normalizing the edge histogram bins contained in 
each edge histogram by S x T to thereby generate M number 
of normalized edge histogram bins for said each image 
10 frame; 

a4) calculating M representative edge histogram bins 
of said query video sequence in order to generate L number 
of representative edge histograms of each video sequence 
based on the normalized edge histogram bins of said each 
15 image frames 

25. The method as recited in claim 23, wherein the 
step a2 ) includes the steps of: 

a2-l) assigning one of the reference edges to each 
20 image block; and 

a2-2) counting the number of each reference edge 
included in each sub-image to generate the L number of the 
edge histograms for the query video sequence. 

25 2.6. The method as recited in claim 25, wherein the 

step a2-l) includes the steps of: 

a2-ll) dividing each image-block into 2x2 sub- 
blocks ; 

a2-12) assigning a corresponding filter coefficient to 
30 each sub-block; 

a2-13) calculating a set of 5 edge magnitudes 
corresponding to five edges for each image-block by using 
the filter coefficient; and 

a2-14) expressing the image-block as an edge having a 
35 maximum edge magnitude by comparing the calculated edge 
magnitudes each other. 



27. The method as recited in claim 26, wherein the 5 
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edge magnitude are obtained by using 5 number of equations, 
which are expressed as: 

3 

m v (?>j) = \ 2 «*('./)*/,(*) I ; 

3 

3 

5 ft ;) - 1 g * * ft ;) x/ rf .45 (*) I ? 

3 

™rf-13S ft /) " | g * * ft /) x/d-135 (*) | ? 
3 

^ft/)" 3 ! ^«*ftj) x /» d (*) | / where m v (i,j) , m h (i 9 j) , m d ^ s (i,j) , 

m rf-i35ft7) and m nd(f>D t respectively, denote vertical, 
horizontal, 45 degree, 135 degree and non-directional edge 

10 magnitudes for a th image-block; a k (i,j) denotes an 

average gray level for a sub-block assigned k in the ftj) th 
image-block and f v (k) , / ft (A:) , f d _ 4s (k) , f d _ l3S (k) and f^ik) denote, 
respectively, filter coefficients for the vertical, 
horizontal, 45 degree, 135 degree and non-directional edges 

15 where k represents a number assigned to each sub-block* 

28. The method as recited in claim 26, wherein the 
maximum edge magnitude is greater than a predetermined 
threshold value, otherwise the image block is considered to 

20 contain no edge. 

29. The method as recited in claim 21, wherein the 
image descriptors for the query and target video sequence 
further include a global edge histogram and R number of the 

25 semi-global histograms based on the Lx5 number of 
representative edge histogram bins, respectively, R being a 
positive integer. 

30. The method as recited in claim 29, wherein the 
30 global edge histogram represents an edge distribution in a 

whole space of the query and target video sequences and 

each semi-global edge histogram represents an edge 
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distribution in a corresponding set of sub-images of the 
query and target video sequences. 

31. The method as recited in claim 29 , wherein said N 
5 and R are 4 and 13, respectively, 

32. The method as recited in claim 31, wherein each of 
the 13 semi-global edge histograms is generated for each of 
13 sets of 4 sub-images, wherein the 13 sets include: four 

10 sets of 4 sub-images, each set including 4 sub- images in 
each of first to fourth columns of the image in vertical 
direction; four sets of 4 sub-images, each set including 4 
sub-images in each of first to fourth rows in horizontal 
direction; four sets of 4 sub-images, each set including a 

15 corresponding sub-image and 3 sub-images neighboring the 
corresponding sub- image , wherein the corresponding sub- 
image is respectively located on the left- top, on the 
right- top, on the left-bottom and on the right-bottom of 
the image; and a set including 4 sub-images around the 

20 center of the image. 

33. The method as recited in claim 21, wherein the 
step b) includes the steps of: 

bl) retrieving L x 5 number of quantization index 
25 values for each of the target video sequence; 

b2 ) converting each of the L x 5 number of 
quantization index values into L x 5 number of 
representative edge histogram bins for said each target 
vides sequence by using 5 number of non- linear inverse 
30 quantization tables; and 

b3) generating L number of representative edge 
histograms based on the L x 5 number of normalized edge 
histogram bins. 

35 34. The method as recited in claim 33, wherein the 

step b) further includes the step of: b4 ) further 
generating a global edge histogram and R number of semi- 
global histograms for each of the target video sequence 
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based on the L x 5 number of representative edge histogram 
bins . 

35. The method as recited in claim 21, wherein the 
5 step b) includes the steps of: 

bl) retrieving L x 5 number of quantization index 
values for each of the target vides sequence; 

b2) converting each of the L x 5 number of 
quantization index values into L x 5 number of 
10 representative edge histogram bins for said each target 
video sequence by normalizing the L x 5 number of 
quantization index values; and 

b3) generating L number of representative histograms 
based on the L x 5 number of representative edge histogram 
15 bins . 

36. The method as recited in claim 35, wherein the 
step b) further includes the step of: b4 ) further 
generating a global edge histogram and R number of semi- 

20 global histograms for each of the target images based on 
the L x 5 number of normalized edge histogram bins. 

37. The method as recited in claim 34, wherein the 
step c) includes the step of: 

25 estimating a distance between the query video sequence 

and said each target video sequence by equation as: 

79 4 

Distance(A 9 B) = ^\ Local _A\i]- Local _B\i] | + 5x^| Global _A\i]~ Global _B\i] \ 

64 

+ Semi _Global_A\i]- Semi _Global_B\i] \ 

30 where Local_A[i] and Local_B[i] denote, respectively, 

the edge histogram bins of BinCountfi] of the query video 
sequence A and the target video sequence B; Global_A[ ] and 
Global_B[] denote, respectively, the edge histogram bins 
for the global edge histograms of the query image A and the 

35 target image B; and Semi_Global_A[ ] and Semi_Global_B[ ] 
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denote , respectively, the histogram bin values for the 
semi-global edge histogram bins of the query video sequence 
A and the target video sequence B. 

5 38. The method as recited in claim 36 , wherein the 

step c) includes the step of: 

estimating a distance between the query video sequence 
and said each target video sequence by an equation as: 

79 4 

Distance(A,B) = Y\ Local _A[i]- Local _B[i] | + 5x Y| Global _A[i]~ Global _B\i] j 

+ Semi _Global_A\i]- Semi _Global_B\i] | 

where Local_ A[i] and Local_B[i] denote, respectively, 
the edge histogram bins of BinCount[i] of the query video 
seqence A and the target video sequence B; Global_A[] and 
Global_B[] denote, respectively, the edge histogram bins 
15 for the global edge histograms of the query video sequence 
A and the target video sequence B; and Semi_Global_A[ ] and 
Semi_Global_B[ ] denote, respectively, the histogram bin 
values for the semi-global edge histogram bins of the query 
video sequence A and the target video sequence B. 

20 

39. A method for extracting an image description for 
video sequence, each having a plurality of image frames of 
the digital video data, the method comprising the steps of: 

a) selecting a one of the image frames as a target 
25 ima ge f r ame ; 

b) calculating Lx5 number of normalized edge histogram 
bins to generate L number of edge histograms of the target 
image, wherein said each edge histogram has 5 number of 
normalized edge histogram bins and represents a spatial 

30 distribution of 5 number of reference edges in a sub-image 
and L is a positive integer, wherein the reference edges 
include 4 number of directional edges and a non-directional 
edge? 

c) selecting a next image frame as a target image; 

35 d) repeating steps b) and c) until L number of edge 
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histograms of all image frames are calculated; 

e) calculating a representative edge histogram having 
LX5 number of normalized edge histogram bins for the video 
sequence based on the L number of edge histograms of each 

5 image frame; 

f) non-linearly quantizing the Lx5 number of 
normalized edge histogram bins of the representative edge 
histograms to generate Lx5 number of quantization index 
values as the image description for the video sequence; and 

10 g) storing the Lx5 number of quantization index values 

to the database, 

40. The method as recited in claim 39 , wherein each 
quantization index value is represented by 3 bits. 

15 

41. The method as recited in claim 39, wherein the 
directional edges include a vertical edge, a horizontal 
edge, a 45 degree edge, a 135 degree edge and the non- 
directional edge represents an edge of undesignated 

20 direction except for the 4 directional edges. 



25 
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